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In 1976 the National Institute of Education 
established the Besearch and Development Otlliiation (EDO) program* 
This project vas intended to apply research and development products 
to local schocl problemai to develop a problem-solving and product 
selection process usable by local schools and to organize a linkage 
system making national, state, and other external resources available 
to local school personnels Seven projects serving over 300 school 
locatloni in 20 states iiere operated under the BOU program from 1976 
to 1979^ Preliminary findings from a study of the program suggested 
that engagement in BDO program activities would promote school 
improvement* Several variables vere eKamined to determine vhich were 
Important to the Impact of the EDO program at the school level* Such 
variables included characteristics of the research and development 
products chosen, degree of modification of externally developed 
products, strategies selected for problem-solving, amount of 
coordination with outside experts, and techniques used during product 
implementation, These variables were found to be more powerful 
predictors of success at loplementlng innovations at the local school 
level than was school "readiness" as measured by previous experience 
with innovative efforts, federally fanded programs, or use of 
externally developed research and development products, 
(Author/MDI 
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In Jimm of 1©76# thm National Institota of l^cmfcion (NIE) eetabliahed 
thm RMearch and DOT©l©pMnt Utilisation (TOU) program as a new aotion^ 
fes^c^ tf£©rt to disgesosinatiaa. This pregram waa deai^sd toi 

• apply RSD pgQdugts^ or ideas ir to scbool problettis; 

m davalop a ggoblm'^Qlviag pnQmmB , whwei^ i^oala 
wmld syat^nati^aliy idantify euoh pfoblssB wd 
salaA and ii^lameflt ideui and 

• organize a llgkage_ayg'tgg / whara]^ national^ state* 
and ether ejctarnml raaoaroas would be WBdm available 
to aohool p^aonnel« 

Thm HDU proepM is unusual Miong federally funded diastoination strate** 

gi^ baoauBe of its dual comDitment to the diss^ination and use of R^D 

prpdugta (mirrioulum innowtions ) 4nd to the development of lo^al lohool 

oapabilities to solve problem torOT.^ tiia us a of externally ganerated 

toowladga* The oore of tta EDO strate^ was to provide aa^ partioipating 

site* whioh was either a school or a distriotj witti aasistanaa in the follow* 

ing sa^uanea of aotlviti^i 

• identif i^tion of a problem or sat of problera? 

• examination of alternative solutions to the problam; 
focusing partioularly on the proAiots educational 

m selection of a specific solution to adtoasa the prob- 
lemi 

• iiqpl^intation of the solution; 

• evaluation and incorporation of both the solution and 
the pr^lem soling process. 

The s^'^ce delivery ^stra of the HDU program operated throu#i seven 
projects/ eaA of whiA coordinated a network of organisations ayad individ- 
uala involved in the provision of services and infoafaation to local schools 
and s^ool districts, hm a whole* the seven projarts operated in 20 statM 
and s^vad over 300 spools or sAool districts over a three-year period 
{1976-li7f). lacii of the projects selaeted and made available a pool of MP 
products f which was also rtf wrad to as a knmledge base. Thmm knowladga 
bas^ ware develop ad as a resource for identify ^g solutions to match oUent 
school needs. Thm projerts also deployed " linking agents " who coordinated 
the services provided to local schools and s^ool districts ^ wd who helped 
guide the local s^ool parsonnel in a s^ool ii^rovemant process. 



la Novs^et 1977 # Abt AsioeiatM Ina. , a soGial seienee resear^ firm 
baged in Cas^rid^^ MaasasEiuiettar wm OTntraeted to contort a itudy of the 
HDtJ progff'M. While we hava al^sad^ protocad a nu^er of iatarin reports 
(Chabot« asd Kail, 1978 1 Loiiie at al, , 197ti Yin, Gwaltney and Lou im, 19B0i 
Spmoer and hmXm, 1979 f KaU and LMia, 1980, Lcniia, 1980) we hav%^ only re- 
oantly co^lntad the ^ta aollertion that will allow us to aas^s the inpact 
of ^e EDU pTO^as on aehoola. CDhua, the following discuasion of finding 
and their is^lioations for iohool a^niatratora is neeasaarily praliiaina^ 
ud limited* * 

PEgM34roAH¥ fmPmOB ABOUT THE MP OTILI2AM0W PBDGHaM 

Besausa a feature of the pro-am desi^ waa its a^ual e^hmsis upon 
the dsGuaientation of MP prodhirta and upon the problam-aol^ing prooess, thm 
diaeussion of our pralittinary finding will be ^vidad aaeordingly. 

Findings telated to the tepligabilitv and mpast of B&D teoducts on 
idhoola 

One of the priiaary motivationa for thm development of the RDU program 
\imm to admass critioa edueational RSD who olairod that ten ya^s of 
ext@^aiva funding had pro^aed little of use to toe adagational Qoosainity* 
One intent of the RSD Utilization Programr was tharefore, to tast whethar 
spools could solve adaoational problera throu^ tiie use of esd^sting resMrcii 
and developsent based "protorts'*. Six projeots that ^velopad product pools 
were Uoitad to produeta in either basic akills or career aducation y while 
one dealt exclusively witii insarvice education # In ad^tion^ all savan 
projeeta Mphaaizad quality control over tha prodttct pool. The proAicts ware 
intmded to show evidance of ef f activeness and e^dance of transportability 
from one site to another. 

In general, KDU projects were able to provide aoceptabla^ attractive 
prodacts to almost all of the schools involved in the program* in only 20 
percent of the casM did projarta find it difficult to "mat^" a spool's 
prcAlem to a locally acceptablap but eacternally developed solution. Further* 
Bsore, the data in^cata ttat the aelected products were received wito enthua* 
iaaa in niost schools s 



♦The final reports from thia stud^ will be avail^le in the winter «nd 
spring of 19S1. This analysis is based upon data collected throu^ site 
visits to iO scdiools mA ^strirts, «d suirveys teasers and principals 
in ISO s^oolsi^ ... ^ - — 
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• A siurroy of teasers oondutted several oonthg after the 

of thm projert ijidiaatee tiiat appr oxi ma t aly 80 pmraent 
of thraa whQ mrm eligible to use the pro&ot arai in fact, 
using it. 

• In addition^ approsdlfflatsly SO pesgent of the lurwyed teaehers 
zmpondrnd anthugiastiMlly to questions a]»ut whether the 
pfoduot prodded new ideas and whether it was direetly relevant 
to the mmt. prising problera or needs in thm s^ool* 

• Finally # prinoipalB report that a fair de^ee of proAirt 
inatitutimalization has alrea^ ©eourred* Sixtyf our per* 
centr for exas^le, in^oate that the progr^ or materials 
have been formally ijigorporated into schDol eurfieulum 
plans* Appro3d.iBately 60 peroent indieate teat loMlly writ- 
tan guidelines for the use of materials and methoda have al- 
ready been developed or will definitely be developed ir i 
near future- sixty- two p^eent preset extensive use . 

the materials or mthods teachers in the future^ 

What dharaoteristiM tiie produot, if my, are related to the desired 

positive outooma or effeots q£ the RgD Utilisation program in sohools? 

Based on Abt Assoaiat^* analysis of data from approxifflately 75 sdiools 

visited either ^ Abt Assooiates staff or oase stu% writers e^loyed by the 

seven projeets^ we have developed five preliaiinary outooTO meMures whiA 

rtf leot the overall ebjeotives of toe pro-am* ^ree of these reflect the 

overall ii^aot of thm program on the sghool* These inoludei 

9 th e seope of implOTentation , or the pereentage of students 
and the percentage ot the student day affeoted by the im* 
plementatim of the produotj 

m institutionalization , (sustained use) of the prooess and 
product; and 

• a soale of org^iizational dhmge j. tapping the amount of 
ia^roveioent in ou«ioulumf materials ^ MthodSr stMOture 
teaAer morale^ and pupil performanoe that ooounred as a 
result of the innoration« 

Pur analyse indioate that ourrioulum product charaoteristias are 

^martigularly strong pre^stgrs of the ^gope of Mpl mentation r of ins^ 

alizationy and of organisational ohange * Thm most inportant proAiet ^aracter- 

istios ues 

• whether or not ttere is My mpirloal evidence of the 
eff eotiveness of toe ptoAx^, in other words ^ whether 
the pr^ttot is fi«ld tested or vaUdatedi 
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9 whrther the prodyict is complex , ^s^ does it 

haw vmny parts ^ md i^ de? ch; many Mpects 

o£ toa school profraa at or a: 

• whrthmr the product is desi -^^l .li direetly r 

in othsr words , whrthar it ated to J mrricalumr 

rathar than to adininistrat: :>rodedares hm spools , 
or to insmrT^oe- 

Ona **non-f inding" is also of j i' Idance* r data do not proirt.de 

support for an emhasis on toe Itoq" ^oping materials locally* 

Variables whi^ tapped local mtaria^ . lorni jnt and the de^ee to whicii 

presets mnderwent substantial aal ions do not rffectively pradict 
any of the OTU outoomsa i 

aLplications of Keliminary ^ ^oduct .ndings for School Mministrators 

In aJLxiioat all of the cas^ th^* vjii studied/ school adndniatrators had a 
clear and decisive role in loosing the strategy for school is^rovement that 
is used the sohool or district, ThuSj he or she may decide whether a 
local iflprovement project will isplOTent yternally developed projecta or 
will attCTpt to develop a new program using internal resources* Our data 
suggest that the school administrator should? in aost casM r consider the use 
of eacternally developed prodticts or practices (at least as a core for the 
change activity). This ^proadi will^ under most circumstances, deliver the 
greatest i^act for lower costs. 

In loosing an eKternally developed product/ tiie school administrator 
should attend to the features of the product that are Ukely to maximise its 
i^act upon the s^ool. In tois case, vaUdation, or the eid-stanee of some 
e^irical evidence of f ectiveness? is an ifflportant criterion, validation 
usually in^ llM other ii^ortant characteristics of the products better 
pa^aging and more easily available materials/ and more experienced trainers, 
who are available to proiri.de assistance both ^fore and after isplementation 
at nominal costs* ^hese factors were particularly i^ortant in obtaining 
teaser acc stance and enthusiasm a tout the curriculum innovations . 

Administrators should also be WMe that, if they wish to prodace 
major school iaprovements# they mst also pick products tiiat are con^leK? 
require lots rf ^ange, Md are ^ffioilt to io^l^ent. There is apparently 
no substitute for hard work in the imiovation process and sinple innovations 
just don't seesi to make mou^ of m iiqpact* In addition ^ admii^strators 
WBimt remei^er that th^ have k^ roles to play in insuring that a new 
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guCTi«lum pwQ&amt "atieks*** Wi fcwnd that aotive administrative support ytm 
mm% CTltieal in planning for continuation of the new praeticas ^ miq^gLn^ 
in or supporting aetiviti^ likei 

• writing sAooL or distrirt^wids sidelines for hew tha 
praetioa shOTld inoo^oratedj 

« "selling" thm progrM to the board or to upper level 
a^iij^itrators i 

• divalopijig M^anieM for trai^ng new staff in the 
desired prartioesi 

• SMuring appropriate le^ela of ^dgetary support* 
Althou^ thasa aotiviti^ wmre oritieal^ th^ are often overlooked* 

Finally r the relative paucity of availahle vali^ted innovatiOM in a 
varied of areas of oritical oonoem to schoola auggesti that aohool adminii- 
trators should preea federal and state agencies to fund sore pro^rt develop- 
ment that is responsive to OTWent eohool and distrlot neeto* Current 
federal prioriti^ do not favor CTirrioulum development, and there are no real 
me^aniaM for "simaing'* the pressing prioritea looal etooatora. ^hia will 
not Aange in the near future withoit support from adiool adminiatratore for 
new polioies. 

fcelifflinMy findings about the teoblem Solving Rcooess 

vmile teaohers md a^iinistratora Ukad thm new pyaotioea th^ adopted^ 
in many eaaea the problem aolving aetii^tiea th^ en^ged in were viewed 
aa even mora fwittul* Many schoola ^awed thm OTU prooeas aa an opportunity 
for uidi^daal gpowth^ or the development of a batter underatanding of 
th# school/ which led to more aignif i«nt attei^ts to ij^rave overall organ- 
izational functioning* ^e problem aolving process in the R&D Utilization 
prograuB was a relatively cos^lex one whi^ involved matering hoth internal 
and eA^nal resourcea* Each €£ tiiaaa will be discussed in tu.^n. 

Intemal Strategies i In most caa», the •'HDU approa^" involved the 

development of an internal problm solving tean; <p which received a mandate 

from the a^ool tod distrirt to take responsibility for defining a problem^, 

« 

exaMning solutions # and planning for ii^lCTentation, as well as monitoring 
and avaluating iB^lementation in some caSM. Th^e teaw typically included 
reprMmtatives Afferent role grTOps wittin the s^ool"t eaters, school 
baaed adriniatrators* and central office actoini a trators or apecialists* 



The p^obiem lalving proaais used in mmt RiDU lehools was quit© diff arant 
from th^r previous innovation p^aeticei* inno^tioM in SGhools, aaeording 
t© Qiir rsapondentar are typically introduced baemuee a principal or mn 
Indl^d^ial In toe distri-rt offios baeomas enciiantad with a praetiae^ and 
it is ii^osad upon a lehool at^f that is not equally sntousiastie. In toa 
R&D Utilisation pro^Mi, in oontraMt, influenes was oentared at the teaoher 
laval f althTO^ tta involveinent of other role groupie iaaluding adni^strators * 
was also ij^ortant* Thui, for axan^le, if we look at the dietrilwtion of 
influmce in selecting a new solution to the idantif led problem, we find that 
oentral office staff had a hi^ level of inf lumca in 24 p^oent of the 
sites # as did prinoipals in 40 peroent of the sitea^ as oontrasted to 65 
peroant of the sites in whi^ teachers also had a hic^ level of influanoe* 
In addition* a survey of prinoipals indicates that fewer than six percent 
beliave the HDU approach to problem solving was n^ distinctly different from 
practices th^ bad previously wigagad in* 

Thm function of the teaM was to increase thm level of effort md the 
^ality of tte problem soling process, (quality dtf ined as a^ttence to a 
planning nioi3.ei of analysing nem63f matting solutions to those needs ^ and of 
carrtul planning for and TOnitoring of i^lementation) * Our data indicate 
that positive school effects rarely occur without a hi#i level of effort * The 
quality of the problem solving process , pMticularly toe degree to which the 
process a^»es to princip les of sound decision mking and plajis, is also a 
strong predictor of organisational chmge, as is the iitf luence of thm local 
team aver the decisions in the process* 

Our data also suggest that changes in participation in problem solving, 
and particularly the involvMaant of teachers in tte problem solving process, 
frequently had significant ^Epacts on teacher morale, conmainication patterns 
within tiie sidiool,^ and individual staff development. 

Of special significance is the finding that broad involvement and 
inf luffice of many role ^oups in the school is specially iB^ortaiit at 
particular stages in the problem solving procass^^mely , when the innovation 
WM selected, during planning for in^lraantation and in mDnitoring the 
iaplemantation activitiM* Broad based involvement is less inportmt in the 
problOT identification process, largely because there appears to be a cons^- 
SU& iji most spools ^□out a range of si^ificant needs or problera. 
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EKteraal gtrafesgies i In addition to the dsv^elopMnt of m intenial 
tearfisr/adsainistMtor team with a broad mandate for deoiiion making r the 
pToammm ^pic^lly involTCd aKtegnal actors, w hiA includad linking agents 
trainers from th© protftiGt de-^eloper or rther eouross. Liracing agsnti variad 
©noniouely in the arount of time they were everted to oomit to each of ^e 
lohoalB they worked with, the roles th^ were expeeted to perform. In 

soma oases they were es^ecttd to serTe only as a conroyinioations link betwe^ 
the project and thm site, including coOTiinicating the projerts' esspectations 
about the type of problm solving artivities that tiie site wmild engage in. 
In other projeots th^ were es^eoted to tiJce strong change agent roles or 
to provide specialised consultant assistMioe in a curriculum area* The 
linking agent and his or her actimtiM had a strong effect on product 
ifl^jiementation md sdiool change, l^aviors that seemed to have the ^eat^t 
intact uei 

9 Thm amotmt of time that linking agents spent witii client 
schooii^was ^^r^nely ij^ortant as ^ predictor of BDU out* 
comes* 

« The amount of influence that the UiAing agent had ovar 
client and team aeti^tisa Md decision making is OTitioal. 
More active "change agent" roles helped schools to process 
mre rapidly^ but did not usually trndersiine local ownership* 

• The de^ee to whiA tiie linking agent adopted a facilitator 
or process role y which involved surfacing and resolving 
inflicts, prodding training and problCT solving in group 
process, Md providing technical assistance in ^acposing 
the prdblem and as s^ sing the mat A betwem innovations and 
solutions is a critical predictor* (Other roles whi^ were 
less significant as predictors were acting as a curriculum 
uea specialist^ or singly a general support person. ) 

Linking agents had the most inf lumce over ^e level of effort devoted 
to problem solving^ the quality of the problem solving process, and the ini- 
tial s^pe of ^^lementation of the product. 

While the role of the interaal team is i^ortant-'particularly in pro- 
ducing longer tera or^ni^ational Ganges— these beneficial outcomes are most 
likely to occur with toa assistance of m exteraal catalyst. Our obs ovations 
in 42 scdiools suggest that s^ool staffs tiiat were a^le to ^ torou^ an ef- 
f active problem solving sequence wlteout tee assistance of an axt^nal agent 
typically had very strrag and comited indigenous leaders hip^'^something which 
bu^ administrators cannot always provide in every instance where it is needed* 



Daspita local ^eeopiition that an aKtemal linkJAg agant wag an iiopor* 
tant part ^ th© pTOeas§# only 54% indicated that thay would uaa the aarvlGes 
of an ssetwnal li^er in a fuarther problem solving effort. Our site ^site 
aiiggtst titiat availability of linkers Lm the teaeon for this respons©~the 
HDU linking rolaa wwa disoontinued in most oai^ after the demise of federal 
funding^ and prinoipala did not know whara to turn to find similar support* 

&ctarnally provided training of looal staff was also oritioal to the 
irolemantation prooass. Thm mora training that was providad^ and the nor a 
relevant it was ass^aad to ba ^ tha putiaipating teachers f ^e ^eater the 
likelihood that real and lasting ohwge would take plaoe« Site id.sit data 
suggests that one^hot training was generally less eff eotive thm a laore 
ooiprihensive training pm^Bm, whiA involved training from a variety of 
souroas# with "rrfrMhw" training over the first year of iB^lamentation. In 
addition, as noted above, the desi^ of training pro^aM for orienting new 
teasers to the use of the innovation are key to oontinued school iz^rovement* 

Bnplioations of a-ooess Findirgs for Sohool Atoinistrators 

Our f^dUln^ suggest ^at teams oan be an tffeAive strate^ in sohool 
i^rovement efforts* Shared decision making facilitates tiia aohievemant of 
school inprovamant objectives spreading tha feeling of projert ownership i 
eliciting BBiltiple perspectiver , iMi^ts, and e^ertise; minimising tha 
effects of a priori aissumptions ; and focusing attention on objectives that 
ndgfit oth^mise be neglected* Shared decision making also ii^roves staff 
^ralei it inproves coordination, coonEur^cation, and articulation within and 
across grade levels; and fosters st^f development* 

A nuaaber of factors can contribute to toe effectiveness of a local action 
team* Hmonq th^e, the most important arei 

• representation on toe team of both adminiatrators and thnse 
who will be directly affected by the decisions, i.e*# teach-* 
ersi 

• adequate preparation for team roles; 

• strmg and effective team leadership, usually from an a^nin- 
istrator; 

• collactiva deliberatim and de^cratic decision mking, par« 
tioularly during later stages in the problem solving process? 

• an active supportive principal (or, if thm principal is 
not actively inTOlved, adequate commanication with the prin- 
cipal ) I 
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• efforts to ipread the feeling of projert ownership to non- 
m adtiafenoe to iwnd problems olvlng praatleeSt 

A fartor in Graating an effective team is thm availability of 
soma adequately co^ensated releaaa tiro for teon members* We have obaerved 
that a little release tiro will stimlate a lot of oonmitffient from teaohers, 
Distriets should reme^er to inolude adequate release time budgets in any 
grMt purposes that are written. In addition ^ if Mnies are ve^ shorty 
adminiatrators should investigate alternative ways of releasing teaohers 
while not disrupting the edueational program (au^ as joint class projects^ 
field trips, eto.). 

In addition, the s^ool admii^strator should, where possible, enoourage 
the involvement of ^eternal linking agents or faoilitators who can become 
involved in helping the sohool to achieve its ^Mge objectives* While 
th^e may be difficult to find^ many interaediate edication districts are 
beginning to encourage their staff members to en^ge in facilitator roles* 
In addition, a school may have access to a central office specialist who is 
eager to play this type of role within the ^strict, miile not strictly an 
external linking agent, a ^strict office pMSon often has the objectivity 
and the flejcible schedule which can allow him/lier to play i-hese roles. 
Finally, the ^strict should not overlook the availability of other resources, 
both from federally funded pro^^^, and from some universitiM which may be 
encoura^ng coranunity sendee md involvement* In selecting a "linking 
agent, " the s^ool a^ttnistrator must remember that toe k^ features of the 
role that were most helpful werei 

m process ^^^rtise (not an indiviflaiii who le^s to bring a 
"solution" to the district)? 

• interest in bailing a sustained relationship with the 
s^ool, not sioply a me-^ijie consulting arrangement i 

• willin^ess to become an active participant in the ohMge 
process, if and whm it is required. 

If no individftal can be found who laerts tiiese criteria, it may perhaps be best 
to "go it alone." Finally, toe school atoinistrator should remember that, 
while a linking a^nt can assist him or her in prodding leadership to the 
ch^ge rffort, toe presence of an actively involved and supportive principal, 
and strong support from the ^strict office are still required for toe chmge 
acti^^ to be a suacess. 
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Sufflffiagy and Ca^eati 

TOie feiults of our preliminaEy analyiis eui^gast that the intec vent ions 
that were part ©£ the original RDU projeet deiign were larfely effeotive* 
Bie underlying aisuioption that both thm availability of high quality productir 
the development of an iaproved problem lolvinf process inside the school # and 
the aocess to enter nal teohniaal assistanoe will promote aohMl is^rovement is 
supported. In addition r the variables related to the MU intervention are more 
powerful predictors of the luooeea of the school l^feOvement efforts in the 
sites served by BDU than in the sohMl*s initial "readinaiSp ** as measured by 
previous eKparience with innovative efforts r with federally funded programs ^ 
with using externally developed RSD products^ eto* 

It ihould be stressed, hmeverr that tiiese results are quite preliminary 
and have not been tested in our larger data base; whioh includes survey 
data from prinalpals and teaohers on a larger sample of HDU sites, h more 
signif ioant limitation of the malysis presented here must be mentioned, 
^he above discussion ea^hasizes a view of school change that is primarily 
"technological'' in nature (House^ 1980)* RDU strategies are viewed as 
■ inputs and the success of the sch^l change program is viewed as the 
"output," We wish to emphasize that our qualitative data suggest that this 
view is siE^listic* In the real world of the school , much of the responsib- 
ility for the success of a change project is dependent not on factors that 
lire predictable r or known at the beginning of the process r but which might be 
labeled "normal critical events." itoong the most important and frequently 
occurring events werei turnover of key administrators . both in the central 
office and in the schooli strikes or prolonged contract negotiations? 
and reductions in force. It should be efl^hasized that critical events do not 
necessarily inpede a school change effort^even strikes may have positive 
ii^acts by increasing the cohesiveness of the school. Whether effects of 
events are good or bad^ however, their impact upon the problem solving 
process and its outcomes are as strong as the findings presented here. Thus, 
in our later analyses we will move beyond a siTOle "technological" perspective 
on the problem of school Improvement , and begin to analyze how other political , 
structural and cultural characteristics of ttie school affect the outcomes of 
the change process. 
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